So, you've decided you want to purchase a machine dedicated to training machine learning models. Or, rather, you work in an organization where the buzzwords of this guide are constantly thrown around and you simply want to know a bit more about what they mean. This isn't a terribly simple topic, so I've decided to write this guide. You can discuss those terms from various angles, and this guide will tackle one of them. I'm Nir Ben-Zvi, a Deep Learning researcher and a hardware enthusiast from early middle school days, where I would tear computers apart while friends were playing basketball (tried that too, went back to hardware pretty fast). In the past few years I got to consult some friends on building deep learning machines for companies of various sizes, and ultimately decided to put that knowledge into this guide. Today I work for trigo, doing some Deep Learning and Data. A lot of the knowledge for this guide came from the decisions made towards building our first deep learning machines. Some parts of this guide are kept despite being way out of date.